| Name | Version | Summary | date |
| langchain-llm-config |
0.1.6 |
A comprehensive LLM configuration package supporting multiple providers (OpenAI, VLLM, Gemini, Infinity) for chat assistants and embeddings |
2025-07-28 03:29:10 |
| kvcached |
0.0.1 |
A KV cache management system that supports on-demand KV cache allocation for LLMs with GPU virtual memory |
2025-07-25 20:40:58 |
| guidellm |
0.2.1 |
Guidance platform for deploying and managing large language models. |
2025-04-29 17:49:39 |
| vllmocr |
0.3.8 |
OCR project using LLMs |
2025-03-13 10:43:39 |
| faster-translate |
1.0.2 |
A high-performance translation library using CTTranslate2 and vLLM. |
2025-03-03 23:14:12 |
| bocr |
0.2.0 |
A Python package for OCR using Vision LLMs |
2025-02-22 13:33:12 |
| openllm |
0.6.19 |
OpenLLM: Self-hosting LLMs Made Easy. |
2025-02-15 07:48:10 |
| sparrow-parse |
0.5.0 |
Sparrow Parse is a Python package (part of Sparrow) for parsing and extracting information from documents. |
2025-01-09 12:28:45 |
| happy-vllm |
1.1.12 |
happy_vllm is a REST API for vLLM, production ready |
2025-01-06 11:07:33 |
| pictoken |
0.1.0 |
Calculate image tokens for (Azure) OpenAI models. Offers multiple utilities to resize images to reduce token usage. |
2024-10-07 21:19:08 |
| optimum-benchmark |
0.4.0 |
Optimum-Benchmark is a unified multi-backend utility for benchmarking Transformers, Timm, Diffusers and Sentence-Transformers with full support of Optimum's hardware optimizations & quantization schemes. |
2024-07-31 08:35:53 |